ar X iv : m at h . ST / 0 70 35 51 v 1 19 M ar 2 00 7 ANOMALIES IN THE FOUNDATIONS OF RIDGE REGRESSION
نویسنده
چکیده
Anomalies persist in the foundations of ridge regression as set forth in Hoerl and Kennard (1970) and subsequently. Conventional ridge estimators and their properties do not follow on constraining lengths of solution vectors using LaGrange’s method, as claimed. Estimators so constrained have singular distributions; the proposed solutions are not necessarily minimizing; and heretofore undiscovered bounds are exhibited for the ridge parameter. None of the considerable literature on estimation, prediction, cross–validation, choice of ridge parameter, and related issues, collectively known as ridge regression, is consistent with constrained optimization, nor with corresponding inequality constraints. The problem is traced to a misapplication of LaGrange’s principle, failure to recognize the singularity of distributions, and misplaced links between constraints and the ridge parameter. Other principles, based on condition numbers, are seen to validate both conventional ridge and surrogate ridge regression to be defined. Numerical studies illustrate that ridge analysis often exhibits some of the same pathologies it is intended
منابع مشابه
ar X iv : m at h / 07 03 55 1 v 1 [ m at h . ST ] 1 9 M ar 2 00 7 ANOMALIES IN THE FOUNDATIONS OF RIDGE REGRESSION
Anomalies persist in the foundations of ridge regression as set forth in Hoerl and Kennard (1970) and subsequently. Conventional ridge estimators and their properties do not follow on constraining lengths of solution vectors using LaGrange’s method, as claimed. Estimators so constrained have singular distributions; the proposed solutions are not necessarily minimizing; and heretofore undiscover...
متن کاملar X iv : m at h . ST / 0 70 35 50 v 1 19 M ar 2 00 7 ANOMALIES IN THE ANALYSIS OF CALIBRATED DATA
This study examines effects of calibration errors on model assumptions and data–analytic tools in direct calibration assays. These effects encompass induced dependencies, inflated variances, and heteroscedasticity among the calibrated measurements, whose distributions arise as mixtures. These anomalies adversely affect conventional inferences, to include the inconsistency of sample means; the u...
متن کاملar X iv : 0 90 3 . 19 51 v 1 [ m at h . ST ] 1 1 M ar 2 00 9 Invariance principles for linear processes . Application to isotonic regression
In this paper we prove maximal inequalities and study the functional central limit theorem for the partial sums of linear processes generated by dependent innovations. Due to the general weights these processes can exhibit long range dependence and the limiting distribution is a fractional Brownian motion. The proofs are based on new approximations by a linear process with martingale difference...
متن کاملar X iv : m at h / 07 03 55 0 v 1 [ m at h . ST ] 1 9 M ar 2 00 7 ANOMALIES IN THE ANALYSIS OF CALIBRATED DATA
This study examines effects of calibration errors on model assumptions and data–analytic tools in direct calibration assays. These effects encompass induced dependencies, inflated variances, and heteroscedasticity among the calibrated measurements, whose distributions arise as mixtures. These anomalies adversely affect conventional inferences, to include the inconsistency of sample means; the u...
متن کامل